Distributed Training Large-Scale Deep Architectures

Scale of data and scale of computation infrastructures together enable the current deep learning renaissance. However, training large-scale deep architectures demands both algorithmic improvement and careful system configuration. In this paper, we focus on employing the system approach to speed up large-scale training. Via lessons learned from our routine benchmarking effort, we first identify bottlenecks and overheads that hinter data parallelism. We then devise guidelines that help practitioners to configure an effective system and fine-tune parameters to achieve desired speedup. Specifically, we develop a procedure for setting minibatch size and choosing computation algorithms. We also derive lemmas for determining the quantity of key components such as the number of GPUs and parameter servers. Experiments and examples show that these guidelines help effectively speed up large-scale deep learning training

Deep Complex U-Net with Conformer for Audio-Visual Speech Enhancement

Recent studies have increasingly acknowledged the advantages of incorporating visual data into speech enhancement (SE) systems. In this paper, we introduce a novel audio-visual SE approach, termed DCUC-Net (deep complex U-Net with conformer network). The proposed DCUC-Net leverages complex domain features and a stack of conformer blocks. The encoder and decoder of DCUC-Net are designed using a complex U-Net-based framework. The audio and visual signals are processed using a complex encoder and a ResNet-18 model, respectively. These processed signals are then fused using the conformer blocks and transformed into enhanced speech waveforms via a complex decoder. The conformer blocks consist of a combination of self-attention mechanisms and convolutional operations, enabling DCUC-Net to effectively capture both global and local audio-visual dependencies. Our experimental results demonstrate the effectiveness of DCUC-Net, as it outperforms the baseline model from the COG-MHEAR AVSE Challenge 2023 by a notable margin of 0.14 in terms of PESQ. Additionally, the proposed DCUC-Net performs comparably to a state-of-the-art model and outperforms all other compared models on the Taiwan Mandarin speech with video (TMSV) dataset

Hedgehog overexpression leads to the formation of prostate cancer stem cells with metastatic property irrespective of androgen receptor expression in the mouse model

<p>Abstract</p> <p>Background</p> <p>Hedgehog signalling has been implicated in prostate tumorigenesis in human subjects and mouse models, but its effects on transforming normal basal/stem cells toward malignant cancer stem cells remain poorly understood.</p> <p>Methods</p> <p>We produced pCX-shh-IG mice that overexpress Hedgehog protein persistently in adult prostates, allowing for elucidation of the mechanism during prostate cancer initiation and progression. Various markers were used to characterize and confirm the transformation of normal prostate basal/stem cells into malignant cancer stem cells under the influence of Hedgehog overexpression.</p> <p>Results</p> <p>The pCX-shh-IG mice developed prostatic intraepithelial neoplasia (PIN) that led to invasive and metastatic prostate cancers within 90 days. The prostate cancer was initiated through activation of P63⁺basal/stem cells along with simultaneous activation of Hedgehog signalling members, suggesting that P63⁺/Patch1⁺and P63⁺/Smo⁺cells may serve as cancer-initiating cells and progress into malignant prostate cancer stem cells (PCSCs). In the hyperplastic lesions and tumors, the progeny of PCSCs differentiated into cells of basal-intermediate and intermediate-luminal characteristics, whereas rare ChgA⁺neuroendocrine differentiation was seen. Furthermore, in the metastatic loci within lymph nodes, kidneys, and lungs, the P63⁺PCSCs formed prostate-like glandular structures, characteristic of the primitive structures during early prostate development. Besides, androgen receptor (AR) expression was detected heterogeneously during tumor progression. The existence of P63⁺/AR^-, CK14⁺/AR^-and CD44⁺/AR^-progeny indicates direct procurement of AR^-malignant cancer trait.</p> <p>Conclusions</p> <p>These data support a cancer stem cell scenario in which Hedgehog signalling plays important roles in transforming normal prostate basal/stem cells into PCSCs and in the progression of PCSCs into metastatic tumor cells.</p

Toll-like receptor 2 gene polymorphisms, pulmonary tuberculosis, and natural killer cell counts

<p>Abstract</p> <p>Background</p> <p>To investigate whether the toll-like receptor 2 polymorphisms could influence susceptibility to pulmonary TB, its phenotypes, and blood lymphocyte subsets.</p> <p>Methods</p> <p>A total of 368 subjects, including 184 patients with pulmonary TB and 184 healthy controls, were examined for TLR2 polymorphisms over locus -100 (microsatellite guanine-thymine repeats), -16934 (T>A), -15607 (A>G), -196 to -174 (insertion>deletion), and 1350 (T>C). Eighty-six TB patients were examined to determine the peripheral blood lymphocyte subpopulations.</p> <p>Results</p> <p>We newly identified an association between the haplotype [A-G-(insertion)-T] and susceptibility to pulmonary TB (p = 0.006, false discovery rate q = 0.072). TB patients with systemic symptoms had a lower -196 to -174 deletion/deletion genotype frequency than those without systemic symptoms (5.7% vs. 17.7%; p = 0.01). TB patients with the deletion/deletion genotype had higher blood NK cell counts than those carrying the insertion allele (526 vs. 243.5 cells/μl, p = 0.009). TB patients with pleuritis had a higher 1350 CC genotype frequency than those without pleuritis (12.5% vs. 2.1%; p = 0.004). TB patients with the 1350 CC genotype had higher blood NK cell counts than those carrying the T allele (641 vs. 250 cells/μl, p = 0.004). TB patients carrying homozygous short alleles for GT repeats had higher blood NK cell counts than those carrying one or no short allele (641 vs. 250 cells/μl, p = 0.004).</p> <p>Conclusions</p> <p>TLR2 genetic polymorphisms influence susceptibility to pulmonary TB. TLR2 variants play a role in the development of TB phenotypes, probably by controlling the expansion of NK cells.</p

Curcumin Remedies Testicular Function and Spermatogenesis in Male Mice with Low-Carbohydrate-Diet-Induced Metabolic Dysfunction

Increasing reports on the significance of dietary patterns in reproduction have arisen from both animal and human studies, suggesting an interactive association between nutrition and male fertility. The aim of this study was to investigate the effects of curcumin supplementation on low-carbohydrate-diet-induced metabolic dysfunction, testicular antioxidant capacity, apoptosis, inflammation and spermatogenesis in male mice. Male C57BL/6 mice were fed a normal diet (AIN-93M group, n = 12) and a low-carbohydrate diet for 12 weeks (LC group, fed with low-carbohydrate diet, n = 48), and mice randomly chosen from the LC group were later fed their original diet (LC group, n = 12). This diet was changed to AIN-93M feed (LC/AIN-93M group, n = 12), a ketogenic diet (LC/KD group, n = 12), or a ketogenic diet treated with curcumin supplementation for the final 6 weeks (LC/KDCu group, n = 12). A poor sperm morphology and mean testicular biopsy score (MTBS) were observed in the LC and LC/KD groups, but they were eliminated by the normal diet or ketogenic diet with curcumin. The LC group exhibited a lower testicular testosterone level and a lower 17β-HSD activity and protein expression. This also enhanced apoptosis protein expressions in testis tissue, including Bax/BCl2, cleaved caspase 3, PARP and NF-κB. Meanwhile, we found a statistically significant increase in lipid peroxidation and decreased superoxide dismutase (SOD), catalase (CAT) and glutathione peroxidase levels in the LC group. Our study indicated that a replacement of a normal diet or ketogenic diet supplemented with curcumin attenuated poor semen quality and reduced testosterone levels by the LC diet by reducing oxidative stress

Effects of Oral Resveratrol Supplementation on Glycogen Replenishment and Mitochondria Biogenesis in Exercised Human Skeletal Muscle

The present study aimed to investigate the effect of oral resveratrol supplementation on the key molecular gene expressions involved in mitochondria biogenesis and glycogen resynthesis in human skeletal muscle. Nine young male athletes participated in the single-blind and crossover designed study. All subjects completed a 4-day resveratrol and placebo supplement in a randomized order while performing a single bout of cycling exercise. Immediately after the exercise challenge, the subjects consumed a carbohydrate (CHO) meal (2 g CHO/Kg body mass) with either resveratrol or placebo capsules. Biopsied muscle samples, blood samples and expired gas samples were obtained at 0 h and 3 h after exercise. The muscle samples were measured for gene transcription factor expression by real-time PCR for glucose uptake and mitochondria biogenesis. Plasma glucose, insulin, glycerol, non-esterified fatty acid concentrations and respiratory exchange ratio were analyzed during post-exercise recovery periods. The results showed that the muscle glycogen concentrations were higher at 3 h than at 0 h; however, there were no difference between resveratrol trial and placebo trial. There were no significantly different concentrations in plasma parameters between the two trials. Similarly, no measured gene expressions were significant between the two trials. The evidence concluded that the 4-day oral resveratrol supplementation did not improve post-exercise muscle glycogen resynthesis and related glucose uptake and mitochondrial biosynthesis gene expression in men

Effects of Iron Supplementation on Testicular Function and Spermatogenesis of Iron-Deficient Rats

Iron deficiency is the most common micronutrient deficiency in the world. Previous studies have shown that iron deficiency increases oxidative stress and decreases antioxidant enzymes, and studies of male infertility indicated that oxidative stress may affect male reproductive functions. The aim of this study was to investigate the effects of iron supplementation on spermatogenesis and testicular functions in iron-deficient rats. Three-week-old male Sprague Dawley (SD) rats were randomly divided into two groups: an iron-adequate control (AI group, 35 ppm FeSO4) and an iron-deficient group (ID group, 4). After three weeks, the iron-deficient group was divided into an original iron-deficient group and five iron-supplemented groups, the latter fed diets containing different doses of FeSO4 (6, 12, 18, 24, and 35 ppm). After five weeks, blood and testis tissue were analyzed. We presented as median (interquartile range, IQR) for continuous measurements and compared their differences using the Kruskal–Wallis test followed by the Mann–Whitney U test among groups. The results showed that as compared with the AI group, the ID group had significantly lower serum testosterone and poorer spermatogenesis (The medians (QR) were 187.4 (185.6–190.8) of AI group vs. 87.5 (85.7–90.4) of ID group in serum testosterone, p p 12 ppm FeSO4 exhibited improvements in antioxidant levels. In conclusion, iron supplementation can abrogate testis dysfunction due to iron deficiency through regulation of the testicular antioxidant capacity